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P REFACE 

Part  of  the  RAND  research  program  consists  of  basic 
support  studies  In  mathematics.  One  aspect  of  this,  of 
very  considerable  applicability  In  large  governmental, 
military,  and  Industrial  operations.  Is  concerned  with 
linear  programming. 

In  the  present  Memorandum  the  author  discusses  the 
basic  structure  of  this  theory. 

This  Memorandum  will  appear  as  part  of  a  book. 
Symposium  on  Mathematical  Optimization  Techniques  to  be 
published  by  the  University  of  California  Press. 
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SUMT'IARY 

In  this  Memorandum,  the  author  discusses  the  simplex 
method  of  linear  programming  In  a  format  designed  to 
exhibit  over-all  structure  rather  than  specific  operational 
details.  Various  terminal  possibilities  are  represented 
schematically  and  geometrically,  and  It  Is  shown  that 
transposition  duality  theorems  can  be  regarded  as  corol¬ 
laries  of  the  duality  theorem  for  a  homogeneous  linear 
program. 
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SIMPLEX  METHOD  AND  THEORY 


1 .  INTRODUCTION 

The  simplex  method  (19^7)  of  George  B.  Dantzig  [l]  Is 
much  more  than  the  basic  computational  tool  of  linear  pro¬ 
gramming.  It  Is  a  combinatorial  algorithm  that  provides 
constructive  means  of  establishing  fundamental  theorems  of 
linear  prograjnmlng  [2] — as  well  as  like  theorems  In  cognate 
areas,  such  as  von  Neumann’s  fUnlmax  Theorem  for  matrix 
games  [3]  and  Parkas'  Theorem  for  linear  Inequalities.  Its 
characteristic  pivot  transformations  are  related  In  an 
essential  way  to  Gauss— Jordan  elimination  [4]  and  to  a 
combinatorial  equivalence  of  matrices  [5]. 

This  paper  discusses  the  simplex  method  In  a  format 
designed  to  exhibit  over-all  structure  rather  than  specific 
operational  details.  The  various  terminal  possibilities 
are  represented  schematically  and  geometrically.  Also, 

It  Is  shown  that  transposition  duality  theorems  [6],  such 
as  the  classical  ones  of  Gordan,  Parkas,  Stlemke  and  Motzkln, 
can  be  regarded  as  corollaries  of  the  duality  theorem  for 
a  "homogeneous  linear  program." 

The  schemata  and  block-^lvot  transformations  used  In 
this  paper  seem  to  be  in¥>ortant  methodological  devices. 

They  follow  closely  along  lines  developed  by  the  author 
In  a  previous  paper  concerned  with  solutions  of  matrix 
games  by  linear  programming  [7]. 


2.  DUAL  LINEAR  SYSTEMS 

This  section  and  the  next  develop  underlying  concepts 
and  format  for  use  in  later  sections. 

The  schema 

-yi  -yj  • • •  -y„ 

(2.1)  ^2 

-  Il  =  ’>2  "In 

is  a  convenient  device  for  the  Joint  presentation  of  two 
systems  of  linear  equations:  a  coliunn  system 

^1^11  ^2^21 
^1^12  ^2^22 

(2.2) 

•  « 

•  • 

k^ln  +  ^2^2n  + 

and  a  row  system 


+  «m^ml  "  'll 

+  %i\s  =  ’>2 

»  • 

»  • 

•  • 


(2.3) 


>  -  AY  =  X  . 


-  -  a22y2 - -  ^g^y^  =  Xg 

•  •  • 

•  •  • 

-  Wl  -  W2 - -  Wn  = 


Ihese  two  systems  are  dual  in  the  sense  that  the  inner 
(scalar)  product  satisfies  the  equation 


(2.4) 


5X  +  HY  -  5(-  AY)  +  (EA)Y  =  0 


for  any  ii,  H  satisfying  the  column  system  (2.2)  and  any 
X,  Y  satisfying  the  row  system  (2.3). 

Ihe  coliunn  system  (2.2)  consists  of  n  linear  equations 
in  m  +  n  variables;  these  n  equations  are  linearly  inde¬ 
pendent  because  each  tj  occurs  with  nonzero  coefficient  in 
Just  one  equation.  The  row  system  (2.3)  consists  of  m 
linear  equations  in  n  +  m  variables;  these  m  equations 
are  linearly  Independent  because  each  x  occurs  with  non¬ 
zero  coefficient  in  Just  one  equation.  If  the  Greek 
variables  5,  H  are  regarded  as  (row)  coordinates  in  a  space 
of  m  +  n  dimensions  and  the  Latin  variables  X,  Y  as  (column) 
coordinates  in  the  same  space,  then  the  solution  sets  of 
(2.2)  and  (2.3)  are  linear  subspaces  of  con^lementary  dimen¬ 
sions  m  and  n,  respectively,  in  the  space  of  m  +  n  dimensions. 
Because  of  (2.4),  these  are  con4)lementary  orthogonal  linear 

subspaces.  Thus  the  "duality"  of  linear  systems  has  the 
geometric  interpretation  of  "orthogonal  complementarity." 


3.  BLOCK-PIVOT  TRANSFORMATION 


Let  A^^  be  a  nonsingular  square  submatrix  of  A,  and 
^12*  ^1*  ^22  remaining  submatrices  of  A.  Then  the 
schema  (2.1)  can  be  rewritten  as 


(3.1) 


Since  A^^  exists. 


the  subsystems 


“1^11  “2^21  “  ^  1  -  ■^11^1  -  ^12^2  “  ^1 
can  be  solved  for  and  to  obtain 

“1  “  ^1^11  ”  “2^1*11  ^1  “  “  •^11^1  “  •^11*12 


Substitution  for  and  in  the  subsystems 


“1^12  “2^22  “  ^2  ^1^1  ^2^2  “  ^ 


yields 


^1^11^12  ■*■  “2^*22  ~  •^21^11^12^ 
^21^11^1  ~  (^2  “  ^1^11^2  ^  ^2 


H2 

Xg  . 


and 


These  results  are  exhibited  by  the  column  and  row  system 
of  the  schema 


The  schema  (3.2)  Is  equivalent  to  the  schema  (3.1)  In  the 
sense  that  the  column  equation  systems  of  (3.1)  and  (3.2) 
have  the  same  solutions  and  the  row  equation  systems 

of  (3.1)  and  (3.2)  have  the  same  solutions  X,  Y. 

Let  r  be  the  order  of  the  non singular  square  submatrix 
All,  the  choice  of  which  determines  uniquely  the  transforma¬ 
tion  from  the  schema  (3.1)  to  the  equivalent  schema  (3.2). 

Hien  the  transformation  from  (3.1)  to  (3.2)  Is  called  a 
block-pivot  transformation  of  order  r,  the  nonsingular 
square  submatrix  of  order  r  being  called  the  block- 
pivot.  It  can  readily  be  verified  that  the  Inverse  of 
the  block— pivot  transformation  from  (3.1)  to  (3.2)  Is  a 
block-pivot  transformation  from  (3.2)  to  (3.1),  the  block- 
pivot  being  Aj^. 

Any  nonzero  entry  of  the  matrix  A  determines  a  block- 
pivot  A^^  of  order  one;  the  corresponding  pivot  transforma¬ 
tion  of  order  one  Is  called  an  elementary  pivot  transformation. 


•6- 


Elementary  pivoting,  utilized  so  effectively  In  the  simplex 
method,  has  Its  roots  In  the  classical  p3?ocess  of  Gauss— 
Jordan  (complete)  elimination. 

Note  that  the  block— pivot  transformation  of  order  r 
from  (3.1)  to  (3.2)  exchanges  r  of  the  Individual  marginal 
labels  at  the  left  with  r  labels  at  the  bottom  and  r 
parallel  labels  at  the  right  with  r  parallel  labels  at  the 
top,  signs  being  reversed  In  the  latter  exchange.  Such  a 
block-pivot  transformation  can  always  be  decomposed  Into 
a  succession  of  elementary  pivot  transformations,  exchanging 
just  one  label  on  a  margin  at  a  time;  conversely,  any  finite 
succession  of  elementary  pivot  transformations  Is  summarized 
by  a  single  block-pivot  transformation  (as  explained  In  [5] 
and  Illustrated  in  [?]). 

The  m  by  n  matrices  In  (3.1)  and  (3.2),  or  any  row 
and/or  colximn  permutations  thereof,  are  comblnatorlally 
equivalent  In  a  sense  discussed  by  the  author  In  [5]. 

4.  DUAL  LINEAR  PROGRAMS 

Here  the  format  developed  In  the  two  previous  sections 
will  be  used,  with  some  change  of  symbols,  to  discuss  dual 
linear  programs. 

Ihe  schema 
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-Xn 


-X, 


— X 


(4.1) 


N 


0 

0 

• 

• 

0 

w 


exhibits  row  and  column  equation  systems 


-  AX  +  B  =  o' 

. 

-  CX  +  d  =  w 

* 


and 


* 

AA  +  C  =  H 
AB  +  d  =  CD 


v;hlch  pertain  to  the  following  pair  of  linear  programs: 

(4.2)  Primal  Program.  To  maximize  w  »  d  —  CX 

constrained  by  AX  =  B,  X  ^  0. 

(4.3)  Dual  Program.  To  minimize  cd  ®  d  +  AB 

constrained  by  AA  +  C  *  H  ^  0. 

(A  vector  Inequality  holds  for  each  component — l.e., 

X  ^  0  means  x^  ^  0,  Xg  ^  0,  ...,  Xj^  ^  0.)  The 'parameters" 
(?v^,  =  A  In  the  Dual  Program  are  unrestricted 

In  sign. 
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Let  be  a  nonsingular  square  submatrlx  of  the 
matrix  A  above.  Ihen  the  schema  (4.1)  can  be  recast  as 


-^1 

OJ 

1 

^1 

^11 

Ai2 

Si 

-  0 

(4.4) 

^2 

A21 

A22 

S2 

-  0 

1 

^1 

d 

»  w 

"“2 

=CD 

(Of  colirse,  the  Ag— headed  : 

row  In  (4.4)  v;lll 

be  vacuous 

If  the 

submatrix  A^^^^ 

omits 

no  row  of  A,  and 

the  Xg— headed 

column 

In  (4.4)  will 

be  vacuous  if  A^^  omits 

1  no  column 

of  A. ) 

- 

A”^  J. 

All,  ^12 

= 

^11^12"  \ 

J.  -  - 
21 

-  A  A“^  T. 

"21  11"  22 

“  *22 

^21^11*12"  ^2 

=  B2  -  A23^A^Jb^ 

-- 

-  ^2 

=  ^2 

-  C^A^j;Aj^2*  ^ 

.  d  - 

Then  the  schema 

0 

-X2 

1 

“1 

\l 

"12 

\ 

-  ^1 

(4.5) 

^2 

hi 

TT 

22 

h 

B  0 

1 

h 

^2  ■■ 

■  w 

-A, 

"^2 

*aco 
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results  from  the  schema  (4.4)  by  the  block— pivot  trans¬ 
formation  having  as  block— pivot. 

Ihe  new  schema  (4.5)  Is  equivalent  to  the  old  schema 

(4.4) .  That  Is,  the  row  equation  system  of  one  schema  is 
satisfied  by  any  X,  w  satisfying  the  row  equation  system 
of  the  other  schema,  and  the  column  equation  system  of  one 
schema  Is  satisfied  by  any  A,  E,  tu  satisfying  the  colvimn 
equation  system  of  the  other  schema.  Hence  the  Primal 
Program  (4.2)  calls  now  for  maximizing  w  subject  to  the 
row  equation  system  of  (4.5)  and  the  Inequalities 

^  Oj  ^2  ^  0,  and  the  Dual  Program  (4.3)  calls  now  for 
minimizing  oi  subject  to  the  column  equation  system  of 

(4.5)  and  the  Inequalities  ^  ^2  ^ 

If  the  schema  (4.5)  Is  such  that 

(4.6)  "522  *  0^  ^2  *  ^  vacuous) 

and 

(4.7)  ■5^  ^  0,  7:2  ^  0, 

then  optimal  (basic)  solutions  of  the  Primal  and  Dual 
Programs,  (4.2)  and  (4.3),  can  be  read  directly  from  (4.5) 
by  setting  variables  at  top  and  left  margins  equal  to 
zero.  These  optimal  solutions  are 


X ( ^  0)  f  X2  —  0 j  w  —  H 


-lO- 


and 


Ai  =  A2  =  0;  =  0,  Eg  =  7^2^^  O)  =  H. 

That  H  Is  the  maximal  v;  follows  from  TJg  ^  0#  because 

w  =  cT  -  ■^2X2  1  H  for  all  X2  ^  0; 

and  that  d  Is  the  minimal  to  follows  from  ^  0*  because 

o)  =  d  +  ^  3  for  all  5^  ^  0. 

The  Dantzlg  simplex  method,  starting  from  an  initial 
"presentation"  of  the  pair  of  linear  programs  (4.2)  and 
(4.3),  employs  a  finite  succession  of  elementary  pivot 
transformations  to  achieve,  if  possible,  a  terminal 
"re— presentation  '  corresponding  to  a  schema  (4.5)  ^’or  which 
(4.6)  and  (4.7)  hold. 

5.  CAJ^ONICAL  REPRESENTATION 

A  canonical  representation  ( "re— presentation" )  of 
the  pair  of  linear  programs  (4.2)  and  (4.3)  is  provided 
by  any  schema 
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(5.1) 


0 

1 

“1 

’ll 

’12  1 

Ag 

^21 

0  1 
_ l_ 

0 

1 

^1 

^2  i 

«Ai 

~2 

for  which  (4.6)  holds.  To  have  7^22  “  ^2  ~  ^1^11^12  “ 

It  Is  necessary  and  sufficient  that  the  order  of  the  block- 
pivot  equal  the  rank  m  of  the  matrix  A,  since  then 

^1^2^  “  ^1^11  ^■^11* '^12^  * 


If  A22  “  0>  then  ^  =  0  also,  unless  AX  =  B  is  an  in¬ 
consistent  system  of  linear  equations. 

A  partly  reduced  canonical  schema 


(5.2) 


results  from  (5.I)  through  deletion  of  the  Ag— headed  row 
in  (5.1).  Ihe  schema  (5.2)  contains  the  same  information 
as  (5.1)  with  redundant  parameters  eliminated. 

A  fully  reduced  canonical  schema 


f 

I 

i 


(5.3) 


1 


1 


=50) 


results  through  further  deletion  of  the  0-headed  column 
of  (5.2).  Ihe  schema  (5.3)  contains  all  the  parameter- 
free  Information  In  (5*1)  or  (5.2). 

If  ^  0  In  the  above  schemata,  the  canonical 
representation  Is  primal  feasible  with  %  (^  O)^ 

=  0  yielding  a  feasible  (basic)  solution  of  the 
Primal  Program  (4.2).  If  ^  ^  4he  above  schemata, 
the  canonical  representation  Is  dual  feasible  with 

Ag  5=  0  and  =  0,  (^  0)  yielding  a 

feasible  (basic)  solution  of  the  Dual  Program  (4.3).  If 
both  ^  0  and  '^2  ^  4he  canonical  representation  Is 
optimal  with  the  above— stated  feasible  (basic)  solutions 
as  optimal  (basic)  solutions  of  the  Primal  and  Dual 
Programs . 

6.  GEOI^TRIC  INTERPRETATION 

Let  the  matrix  A  In  schema  (4.1)  have  rank  m  and 
let  the  number  of  columns  of  A  be  N  =  m  +  n.  Let  [A,  B) 
also  have  rank  m,  so  that  AX  =  B  Is  a  consistent  system 
of  linear  equations.  Let  S  be  a  space  of  N  =  m  +  n 
dimensions  with  a  specified  coordinate  system,  so  that 
there  Is  a  one— to— one  coorespondence  between  points 
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(or  vectors)  of  S  and  ordered  coordinate  N-tuples,  written 
as  ^2*  •••>  usage  and  as  ^2$  •••, 

for  column  usage.  Cien  the  solution  sets 

P  =  {E|5  =  AA  +  C,  all  a}  and  Q  =  {X|AX  =  B} 

are  linear  manifolds  of  con^)  lament  ary  dimensions  m  and  n 
in  the  space  S.  Let  H  =  AA  +  C  and  H'  =  A'A  +  C  be  any 
two  points  of  P,  and  X  and  X'  any  two  points  of  Q.  Then 
the  equation 

(H'  -  E)(X»  -  X)  =  (A'A  -  AA)(X'  -  X)  = 

(A*  -  A)(AX‘  -  AX)  »  0 

shows  that  P  and  Q  are  conplementary  orthogonal  linear 
manifolds  In  S. 

Let 


R  .  {S|E  ^  0}  =  {X|X  ^  0} 

be  the  nonnegative  orthant  in  S.  Then  the  feasible 
solution  sets 

{E|S  =  AA  +  C,  E  ^  0}  and  {X|AX  =  B,  X  ^  O} 


of  the  Dual  and  Primal  Programs  (4.3)  and  (4.2)  are  the 
polyhedral  convex  sets  POR  and  Qf'R,  respectively. 


In  a  canonical  schema  (5- 3)  the  complementary 
orthogonal  linear  manifolds  P  and  Q  are  represented  by 
equation  systems  In  the  following  "slope-intercept"  form. 


(6.1)  P;  ^2  =  +  ^2 


and 


(6.2)  Q:  7J2)  +  ^  . 

the  latter  being  obtained  by  transposing  =  -  '^2.2^  "*■  ^ 

and  substituting  5^  and  for  xj  and  x|.  In  (6.1)  the 

m  by  n  matrix  Is  the  H^-slope"  of  P  (with  5^  as 

"rise"  and  as  "iMn")  and  "Cg  Is  the  "Eg-lntercept"  of  P. 

In  (6.2)  the  negative-transpose  matrix  -  ijg  Is  the 

“1*  ^  (with  as  "rise"  and  as  "run") 

T 

and  Is  the  "H^— intercept "  of  Q.  This  canonical  "slope- 
intercept"  representation  of  P  and  Q,  Introduced  by  the 
author  In  [8],  Is  Illustrated  In  Fig.  1. 

Let  p  and  q  be  the  Intercept  points  (vectors) 

“2^  *  0,  ^2  =  and  =  ^1^  ^2  ~  ^ 

determined  by  (6.1)  and  (6.2).  Note  that  the  Inner 
(scalar)  product 
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P-5  =  10.  Cg]  [^]  =  0  . 

As  canonically  represented  In  schema  (5.3),  the  Dual 
Program  Is  to  minimize 

tu  =  ci  +  ^ 


=  ^  +  p.q 


for  p  In  Pr^R,  and  the  Primal  Program  Is  to  maximize 


w  =  cT  — 


H  - 


[0,T?2] 


'5  -  p*q 


for  q  In  Q/^R.  If  p  belongs  to  P^R  and  q  belongs  to 
QHR,  then  p*q  ^  0  for  every  p  in  PAR  and  p*q  ^  0  for 
every  q  In  QOr  (since  any  two  vectors  In  R  have  a  non- 
negative  Inner  product).  Hence,  since  p*q  *=  0,  It  Is 
clear  that 


cu  =  ^  +  P*q  +  p*q  =  H  for  every  p  In  PHR 


and  that 


w  =  cT  —  p*q  1  3  —  p.q  =  H  for  every  q  In  QHR. 

That  Is,  the  desired  minimum  and  maximum  are  attained  at 
p  »»  p  and  q  »  q  If  these  points  both  belong  to  R.  (The 
Intercept  points  p  or  q  which  belong  to  R  are  the  extreme 
points  of  the  polyhedral  convex  set  PHR  or  QDR. ) 
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In  summary,  this  geometric  interpretation  of  a  pair 
of  linear  programs  (4.2)  and  (4.3)  Involves  complementary 
orthogonal  linear  manifolds  P  and  Q  in  a  space  3  with 
nonnegative  orthant  R.  If  PH R  is  nonvacuous,  the  IXial 
Program  is  feasible;  if  QDR  is  nonvacuous,  the  Primal 
Program  is  feasible.  A  canonical  representation  of  these 
programs  Involves  a  joint  "slope— Intercept "  representation 
of  P  and  Q.  Ihe  resulting  intercept  points  p  and  q  yield 
optimal  solutions  if  they  both  belong  to  R. 

7.  SHIP  LEX  FiETHOD;  TERiviINAL  POSSIBILITIES 

Let  AX  =  B  have  a  solution  X  ^  0,  i.e.,  QHR  is 
nonvacuous  and  the  Primal  Program  (4.2)  is  feasible. 

Then  a  proof  of  the  simplex  method,  such  as  iS],  demon¬ 
strates  the  existence  of  a  finite  succession  of  elemen¬ 
tary  pivot  transformations  that  terminates  in  a  canonical 
repz’esentatlon  for  which  the  matrix 


(7.1) 


of  the  schema  (5*3)  has  either  the  schematic  form 


(7.2) 
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or  the  schematic  form 

(7.3) 


where  each  @  denotes  an  entry  positive  or  zero,  each  0 
an  entry  negative  or  zero,  and  —  a  negative  entry.  The 
@-row  and  @-colvimn  In  (7.2)  determine  optimal  extreme 
points  of  PAr  and  QHR,  the  corner  entry  *  being  the 
common  minimum  and  maximum  value.  In  (7.3)  the  @-coliimn 
determines  an  extreme  point  q  of  Q/^R  and  the  0  —column 
determines  the  direction  of  an  extreme  ray  of  QHR  Issuing 
from  q,  along  which  the  objective  function  w  -»  400  because 
of  the  corresponding  minus  entry  at  the  bottom.  At  the 
same  time  the  (  0  ,  —)— column  In  (7.3)  shows  that  PHR  Is 
vacuous  and  the  Dual  Program  Is  Infeasible. 

If  AX  =  B  Is  a  consistent  system  having  no  solution 
X  ^  0,  so  that  Q  exists  but  QOR  Is  vacuous  and  the 
Primal  Program  (4.2)  is  Infeasible,  then  it  can  be  shown 
that  there  exists  a  finite  succession  of  elementary  pivot 
transformations  terminating  In  a  canonical  representation 
for  which  the  matrix  (7.I)  of  the  schema  (5.3)  has  either 


the  schematic  form 
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©  •  •  • 

TT 

1 

(7.4) 

1 

1 

©  ... 

® ! 

or  the  schematic  form 


(7.5) 


0 

• 

1 

1 

1 

• 

• 

•  •  •  0  •  •  • 

• 

©  1  - 
\ 

• 

• 

© 

1 

1 

1 

- t - 

1 

J _ 

In  (7.4)  the  0  -row  at  the  bottom  determines  an  extreme 
point  p  of  PHr  and  the  other  @ -row  determines  the 
direction  of  an  extreme  ray  of  FOR  Issuing  from  p,  along 
which  the  objective  function  a>  — »  -00  because  of  the 
corresponding  minus  entry  at  the  right.  In  (7.5)  the 
nonpositive  column  with  negative  entry  at  bottom  shows 
that  FOR  is  vacuous  and  the  Dual  Program  is  infeasible. 

The  (  ©  ,  -)-row  in  (7.4)  and  (7.5)  confirms  that  QDH 
is  vacuous  and  the  Primal  Program  is  infeasible. 

In  summary,  the  terminal  possibilities  for  the  simplex 
method  are,  in  the  format  of  this  paper: 
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Form  (7.2)  -  Primal  feasible  (QOR  ^  0), 

Dual  feasible  (PHR  +  <t>)  • 

Form  (7*3)  —  Primal  feasible  (QHR  ^0), 

Dual  Infeasible  (P/^R  =  0). 

Ponii  (7.4)  -  Primal  Infeasible  (QOR  =  0)» 

Dual  feasible  (PAR  +  0). 

Form  (7.5)  —  Primal  Infeasible  (QAR  4“  ^) » 

Dual  feasible  (PAR  =  0). 

From  any  Initial  presentation  (4.1)  of  a  pair  of  linear 
programs  (4.2)  and  (4.3),  provided  AX  =  B  Is  a  consistent 
system  of  linear  equations  (so  that  Q  exists).  It  Is 
possible  through  a  finite  succession  of  elementary  pivot 
transformations  to  reach  a  terminal  canonical  representa¬ 
tion  for  which  the  matrix  (7*1)  of  the  schema  (5*3)  has 
one  of  the  above  four  forms  (7.2),  (7.3),  (7.4),  (7.5). 

8 .  HOMOGENEOUS  LINEAR  PROGRAMS  AND  TRANSPOSITION — 


In  the  pair  of  linear  programs  (4.2)  and  (4.3)  take 
B  =  0  and  d  =*  0  to  get  a  homogeneous  linear  program, 

(8.1)  Minimize  CX  constrained  by  AX  =  0,  X  ^  0, 
and  Its  dual  program. 


(8.2) 


Solve  UA  +  C  ^  0. 
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(Here  It  seems  convenient  to  minimize  CX  =  —  w  rather  than 
to  maximize  vj  =  —  CX,  to  replace  the  parametric  A  by  U, 
and  to  omit  H.)  The  programs  (8.1)  and  (8.2)  are  Jointly 
exhibited  by  the  schema  . 


(8.3) 


(^0) 

=  0 
=  min 

^  0 


Ihe  homogeneous  linear  program  (8.1)  Is  clearly 
feasible,  since  X  =  0  satisfies  AX  =  0.  There  are  Just 
two  possibilities  (corresponding  to  the  two  cases  set 
forth  In  the  first  paragraph  of  Sec.  7):  Either  CX  has 
a  zero  mlnlmxun  and  (8.2)  Is  feasible  or  CX  Is  unbounded 
below  for  feasible  X  and  (8.2)  Is  Infeasible.  These  two 
possibilities  establish  a  "theorem  of  alternatives"  for 
a  homogeneous  linear  program  (8.1)  and  Its  dual  (8.2): 

Theorem  1.  Either  UA  +  C  ^  0  for  some  U  or 

CX  <  0  for  some  X  ^  0  such  that  AX  =  0  (but  not  both). 

This  theorem  can  be  regarded  as  a  fundamental  existence 
theorem  for  an  arbitrary  system  UA  +  C  ^  0  of  nonhomogen eous 
linear  Inequalities : 

Theorem  2.  UA  +  C  ^  0  for  some  U  If,  and  only  If, 

there  Is  no  X  ^  0  for  which  AX  =  0  and  CX  <  0. 
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Take  C  <  0.  Then  UA  +  C  ^  0  Implies  UA  ^  -  C  >  0. 
Also,  CX  <  0  for  X  ^  0  If,  and  only  If,  X  4  0*  Hence, 
Theorem  1  yields  the  following  classical  theorem  of 
Giordan  (and  later  Stlemke),  which  seems  to  have  been  the 
earliest  known  Transposition  Duality  Theorem  (see  [6]): 

Theorem  3.  AX  =  0  for  some  X  ^  0  (i.e. ,  X  ^  0 
and  4=  0)  if j  and  only  if,  UA  >  0  for  no  U. 

Now  form  the  schema 


(8.4) 


(^0) 

=  0 
=  min 

^0^0 


where  A  is  a  matrix,  and  —  B  an  additional  colvimn. 
Clearly  -  UB  -  1  ^  0  implies  UB  ^  -  1  <  0,  and 
-  BXq  +  AX'  =  0  for  Xq  >  0,  X'  ^  0  implies  AX  =  B  for 
X  =  (X'/Xq)  2  0*  Hence  the  alternatives  of  Theorem  1, 
applied  to  (8.4),  establish  the  following  classical 
theorem  of  Farkas  concerning  "convex  linear  dependence"; 

Theorem  4.  If  UB  ^  0  for  all  U  such  that  UA  ^  0, 
then  B  =  AX  for  some  X  ^  0  (and  conversely). 


Next  form  the  schema 
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(8.5) 


u 

1 


^1  ^  ^3  ^ 

^2  ^3  “'^3 

-10  0  0 

^0  ^0  ^0  ^0 


0 

min 


where  -1  denotes  a  row  of  -I's.  Observe  that  ^  1 
Implies  UA^  >  0  and  that  UA^  ^  0,  -UA^  ^  0  Implies 
UA^  =  0.  Let  -  X^.  Then  Theorem  1,  applied  to 

(8.5)  establishes  the  general  transposition  theorem  of 
T.  3.  iMotzkln: 

Hieorem  5.  Either  UA^^  >  0,  UA^  ^  0,  UA^  =  0  for 
some  U  or  +  A^X^  +  A^X^  =  0  for  some  X^^  ^  0, 

X2  ^  0,  X^  unrestricted. 

9.  THEOREMS  FOR  SKEW  AND  DUAL  LINEAR  SYSTEMS 

Let  K  be  a  skew— symmetric  (square)  matrix,  l.e., 
k'^  =  —  K,  and  I  the  Identity  matrix  of  equal  order.  Form 
the  homogeneous  linear  program  and  Its  dual : 


(9.1) 


X 

Y 

z 

(^0) 

u 

K+I 

K 

I 

=  0 

1 

-1 

0 

0 

=  min 

^0 

denotes  a 

3?OW 

of  - 

-I's. 

Premultiply 


(K  +  I)X  +  KY  +  IZ  =  0 
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by  (X  +  Y)^  to  get 

(X  +  Y)*^  K(X  +  Y)  +  (X  +  Y)'^  I(X  +  Z)  =  0. 

Ttien,  since  (X  +  Y)'^  K(X  +  Y)  =  0, 

x'^x  +  x'^z  +  y'^x  +  y'^Z  =  0. 

However,  this  holds  for  X^O,  Y^O,  Z^O  if,  and  only 
If,  each  term  Is  zero;  and  X^X  =  0  if,  and  only  if,  X  =  0. 
Hence,  the  homogeneous  linear  program  specified  by  the 
rows  of  (9.1)  has  a  zero  minimum  and  the  dual  program 
specified  by  the  columns  of  (9.1)  is  feasible.  Tliat  is, 
there  exists  some  U*  satisfying  the  column  inequalities 
of  (9.1): 

U(K  +  I)  ^  1  >  0,  UK  ^  0,  UI  ^  0. 

Ihls  establishes  the  following  "skew— symmetric  matrix 
theorem"  (see  [6],  IJieorem  5): 

Theorem  6.  The  system  UK  ^  0  of  homogeneous  linear 

T 

inequalities,  where  K  =  —  K,  possesses  a  solution 
U*  ^  0  such  that  U*  +  U  K  >  0. 


Apply  Theorem  6  to  the  matrix 
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r  0  Ai 


nien  the  Inequality 


possesses  a  solution 


E*  ^  0,  Y*  ^  0  such  that 


+  {H*, 


>  0. 


Ihls  establishes  the  following  theorem  (see  [6],  Theorem  3) 
concerning  the  dual  linear  systems  of  schema  (2.1)  in 
Sec.  2: 


Theorem  7.  The  column  and  row  equation  systems  of 
the  schema 


30.x 

-H 

possess  solutions  H  ^  0,  H  ^0  and  X  ^  0,  Y  ^  0 
such  that 

E*  +  X*'^  >  0  anl  H*  +  Y*"^  >  0. 
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Apply  Theorem  7  to 


-^1 

^2 

“1 

All 

Ai2 

-A^2 

s+ 

“2 

Agi 

A22 

~^22 

“2 

-A2I 

-A22 

^22 

“  1 

+ 

“  2 

“  2 

where  Is  an  arbitrary  submatrix  of  a  matrix  A  and 
^12*  ^21*  ^2  remaining  submatrices.  Then  there 

exist  nonnegative  solutions  (starred)  of  the  column  and 
row  equation  systems  of  (9*2)  such  that 


)  +  [X 


*T 


>  0 


and 


]  + 


]  >  0  . 


Since  the  sum  of  the  last  two  columns  of  (9*2)  is  zero, 
and  also  the  sum  of  the  last  two  rows. 

Hence /Yg*#  ^2*  ^2*'  nonnegative,  are  all 

zero.  Now  set 


“2 


"2  —  “2*  ^2  **  ^2  —  ^2 

X+  -  Xj,  Yg  =  ^  ^ 


and 
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to  obtain  the  following  general  transposition  duality 
theorem  for  dual  linear  systems  (see  [6],  Theorem  6): 

Theorem  8.  The  column  and  row  equation  systems  of 
the  schema 


-^1 

-^2 

“1 

^1 

Ai2 

^2 

^1 

A22 

-M2 

possess  solutions 


and 


^  0,  X2  •=  0,  Yj  ^  ^2  ^  ^ 

such  that 

*  *'r  *  *T 

Hi  +  >  0  +  Yj^^  >  0  . 
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